Image processing apparatus, image processing method, and storage medium

ABSTRACT

The image processing apparatus in the present invention is an image processing apparatus that supplies roughness shape data to an image forming apparatus that forms a roughness shape based on a roughness shape of an object to be reproduced. The image processing apparatus includes: an input reception unit configured to receive an input of information representing the roughness shape of the object to be reproduced; an acquisition unit configured to acquire output characteristics relating to a roughness shape that the image forming apparatus can output; and a generation unit configured to generate roughness shape data that is supplied to the image forming apparatus based on the information representing the roughness shape of the object to be reproduced and the output characteristics.

BACKGROUND OF THE INVENTION

Field of the Invention

The present invention relates to an image processing apparatus thatgenerates roughness shape data, an image processing method, and astorage medium that stores programs for implementing the apparatus andthe method.

Description of the Related Art

As a method of forming a three-dimensional shape, such as a roughnessshape and a structure, a layer stacking method is known in which an inkjet or electrophotographic image forming apparatus stacks a curableresin printing material or the like. As the image forming apparatus suchas this that performs formation of a roughness shape and a structure, animage forming apparatus is known that can reproduce a stereoscopiceffect and a texture by performing formation of a roughness shape andprinting of an image on a printing medium almost simultaneously.Japanese Patent Laid-Open No. 2004-299058 has disclosed a method ofrepresenting a stereoscopic effect and a texture by forming and stackinga roughness layer for representing large roughness, a roughness layerfor representing fine roughness, and a layer for drawing an image one ontop of another.

SUMMARY OF THE INVENTION

In general, there is a case where an image forming apparatus that formsa roughness shape cannot reproduce a roughness shape faithfully even byforming the roughness shape based on three-dimensional shape data. Thereason is that the curable resin printing material has the surfacetension and wetting spreading characteristics. For example, even in thecase where the image forming apparatus outputs a resin printing materialbased on the roughness shape data specifying a sharp roughness shape inorder to reproduce a sharp roughness shape, the shape changes before theresin printing material solidifies, and therefore, a sharp roughnessshape cannot be reproduced. Alternatively, even in the case where theimage forming apparatus outputs the resin printing material based on theroughness shape data specifying a shape in which the difference ofelevation in roughness is large, the resin printing material for forminga convex portion spreads up to a concave portion, and therefore, thedifference of elevation cannot be maintained.

Because of this, an object of the present invention is to generate datafor an image forming apparatus to output a structure so that the imageforming apparatus that reproduces a structure having a roughness shapecan form an output having a desired texture. The image processingapparatus according to the present invention is an image processingapparatus that supplies roughness shape data to an image formingapparatus that forms a roughness shape based on a roughness shape of anobject to be reproduced, and includes an input reception unit configuredto receive an input of information representing the roughness shape ofthe object to be reproduced, an acquisition unit configured to acquireoutput characteristics relating to a roughness shape that the imageforming apparatus can output, and a generation unit configured togenerate the roughness shape data that is supplied to the image formingapparatus based on the information representing the roughness shape ofthe object to be reproduced and the output characteristics.

Further features of the present invention will become apparent from thefollowing description of exemplary embodiments (with reference to theattached drawings).

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A to FIG. 1D are schematic diagrams showing output examples of aroughness shape;

FIG. 2 is a block diagram showing an outline configuration of an imageforming system in a first embodiment;

FIG. 3 is a schematic diagram explaining an outline configuration of animage forming apparatus in the first embodiment;

FIG. 4 is a schematic diagram explaining an image forming operation inthe first embodiment;

FIG. 5 is a diagram showing an example of a stacked layer section of aroughness layer and an image layer in the first embodiment;

FIG. 6 is a schematic diagram showing output conditions of the imageforming apparatus in the first embodiment;

FIG. 7 is a block diagram showing a function configuration of the imageforming system in the first embodiment;

FIG. 8 is a diagram showing the relationship of FIGS. 8A and 8B;

FIG. 8A is a flowchart showing a procedure of the image forming systemin the first embodiment;

FIG. 8B is a flowchart showing a procedure of the image forming systemin the first embodiment;

FIG. 9 is a diagram showing an example of a histogram of a heightdistribution of a roughness shape in the first embodiment;

FIG. 10 is a flowchart showing a procedure of frequency correction inthe first embodiment;

FIG. 11A is a schematic diagram showing a roughness shape beforesmoothing processing in the first embodiment;

FIG. 11B is a schematic diagram showing a roughness shape aftersmoothing processing in the first embodiment;

FIG. 11C is a schematic diagram showing a roughness shape after heightrestoration processing in the first embodiment.

FIG. 12 is a flowchart showing a procedure of amplitude correction inthe first embodiment;

FIG. 13A is a schematic diagram showing a transition of a roughnessshape before height subtraction processing in the first embodiment;

FIG. 13B is a schematic diagram showing a transition of a roughnessshape after height subtraction processing in the first embodiment;

FIG. 14A is a schematic diagram showing a transition of a roughnessshape before reduction processing in the first embodiment;

FIG. 14B is a schematic diagram showing a transition of a roughnessshape after reduction processing in the first embodiment;

FIG. 14C is a schematic diagram showing a transition of a roughnessshape after sharpening processing in the first embodiment;

FIG. 15 is a flowchart showing a procedure of amplitude/frequencycorrection in the first embodiment;

FIG. 16 is a flowchart showing a procedure of an image forming system ina second embodiment;

FIG. 17 is a diagram showing an example in which roughness shape data isdivided into a plurality of areas in the second embodiment;

FIG. 18 is a flowchart showing a procedure of an image forming system ina third embodiment;

FIG. 19 is a flowchart showing a procedure of image data correction inthe third embodiment;

FIG. 20 is a schematic diagram showing a position relationship of anincidence angle θ and a rotation angle φ in the third embodiment;

FIG. 21 is a schematic diagram showing a part of a roughness shape inthe third embodiment;

FIG. 22A is a diagram showing a height distribution of a roughness shaperepresented by roughness shape data in the third embodiment;

FIG. 22B is a diagram showing a height distribution of a formedroughness shape in the third embodiment;

FIG. 22C is a diagram showing an illuminance distribution of a roughnessshape represented by roughness shape data in the third embodiment;

FIG. 22D is a diagram showing an illuminance distribution of a formedroughness shape in the third embodiment;

FIG. 22E is a diagram showing an ideal illuminance distribution E1 inthe third embodiment;

FIG. 22F is a diagram showing a predicted illuminance distribution E2 inthe third embodiment;

FIG. 23A is a diagram showing an example of a correction coefficient inthe third embodiment;

FIG. 23B is a diagram showing an output example of image data beforecorrection in the third embodiment;

FIG. 23C is a diagram showing an output example of image data aftercorrection in the third embodiment;

FIG. 24 is a diagram showing the relationship of FIGS. 24A and 24B;

FIG. 24A is a flowchart showing a procedure of an image forming systemin a fourth embodiment;

FIG. 24B is a flowchart showing a procedure of an image forming systemin a fourth embodiment; and

FIG. 25 is a diagram showing an example of a user interface in a fifthembodiment.

DESCRIPTION OF THE EMBODIMENTS

Hereinafter, embodiments for embodying the present invention areexplained with reference to the drawings. However, the componentsdescribed in these embodiments are merely exemplary and are not intendedto limit the scope of the present invention to those embodiments.Explanation is given by attaching the same reference letters or numeralsto the same configurations.

First Embodiment

In a first embodiment, a method of correcting roughness shape data of anobject to be reproduced in accordance with an image forming apparatusthat outputs a structure is explained. In particular, in the firstembodiment, in order to represent a desired texture, the frequency andamplitude of the roughness shape data are corrected. Before explainingthe configuration of the first embodiment, a correction method ofroughness shape data is considered. In the case where the image formingapparatus cannot reproduce a shape specified by roughness shape data asthe results of producing an output based on the roughness shape data, amethod is conceivable that performs correction, such as enlargement andreduction, for the roughness shape data. However, only by simplyperforming enlargement or reduction for the roughness shape data, thereis a case where it is not possible to output a roughness shaperepresenting a desired texture. An example in which it is not possibleto output a roughness shape representing a desired texture is shown ineach schematic diagram of FIG. 1A to FIG. 1D. FIG. 1A is a schematicdiagram showing an example of a roughness shape S1. Reference letters Hand G indicate the maximum height of the roughness shape S1 and adifference of elevation of the roughness shape S1, respectively. FIG. 1Bis a schematic diagram showing an example of a roughness shape S1′.Reference letters H′ and G′ indicate the maximum height of the roughnessshape S1′ and a difference of elevation of the roughness shape S1′,respectively. The roughness shape S1′ is the roughness shape S1 reducedso that that the height H′ falls within an output possible range of theimage forming apparatus while maintaining the relationship ofsimilarity. As the roughness shape is reduced from S1 to S1′, thedifference of elevation of the roughness shape is also reduced from G toG′. In the case where the difference of elevation G of the roughnessshape S1 is comparatively small, the difference of elevation G′ afterthe reduction will be too small to recognize, and therefore, thecontrast of shade will be lost.

Another example in which it is not possible to output a roughness shaperepresenting a desired texture only by simply performing enlargement orreduction for roughness shape data is explained below. FIG. 1C is aschematic diagram showing an example of a roughness shape S2. A convexportion P in the roughness shape S2 is a sharp shape (e.g., thesectional shape is like a sawtooth wave). FIG. 1D is a schematic diagramshowing an example of a roughness shape S2′ that is actually output. Aconvex portion P′ in the roughness shape S2′ is a dull shape compared tothe convex portion P in the roughness shape S2. The reason is that theresin printing material output by the image forming apparatus collapsesbefore solidifies with the sharp shape being kept due to the surfacetension and wetting spreading characteristics in accordance with thekind of resin printing material. In the case where reduction isperformed for the roughness shape data so as to avoid the influence ofthe characteristics of the resin printing material, the convex portionP′ of the roughness shape S2′ becomes a dull shape and the sharpness ofthe shade represented by the roughness shape S2 will be lost.Consequently, in the first embodiment, the roughness shape data iscorrected so that the texture of the resin printing material output bythe image forming apparatus is maintained.

<Outline Configuration of Image Forming System>

FIG. 2 is a block diagram showing an outline configuration of an imageforming system 1 in the present embodiment. In the image forming system1 in FIG. 2, a host 100 is, for example, a computer and includes a CPU101, a memory 102, an input unit 103 consisting of a keyboard, a mouse,etc., and an external storage device 104. Further, the host 100 includesa communication interface (hereinafter, described as printer I/F 105)with an image forming apparatus 200 and a communication interface(hereinafter, described as video I/F 106) with a monitor 110. The CPU101 performs various kinds of processing in accordance with programsstored in the memory 102. The programs are stored in the externalstorage device 104 or supplied from an externally connected informationprocessing apparatus, not shown. The host 100 receives inputs of variouskinds of information through the input unit 103 as well as outputtingvarious kinds of information to the monitor 110 via the video I/F 106.Further, the host 100 is connected with the image forming apparatus 200via the printer I/F 105 and transmits image data on which processing hasbeen performed to the image forming apparatus 200 to cause the imageforming apparatus 200 to form an image. It is also possible for the host100 to receive various kinds of information, such as the size of theroughness shape that can be output, from the image forming apparatus 200via the printer I/F 105. In the present embodiment, the host 100constitutes an image processing apparatus.

<Outline Configuration of Image Forming Apparatus>

FIG. 3 is a schematic diagram explaining an outline configuration of theimage forming apparatus 200 in the present embodiment. In the presentembodiment, the image forming apparatus 200 is implemented by an ink jetprinter that forms a roughness layer and an image layer by using aplurality of kinds of ink. A head cartridge 201 of the image formingapparatus 200 has a print head including a plurality of ejection portsand a plurality of color ink tanks for supplying ink to the print headand is provided with a connector for transmitting and receiving signalsor the like to drive each ejection port of the print head. The ink tankstoring a liquid resin ink for forming a roughness layer is providedindependently of the ink tanks storing a plurality of color materialinks for forming an image layer. The head cartridge 201 is mounted on acarriage 202 in an exchangeable manner after being positioned and thecarriage 202 is provided with a connector holder for transmitting adrive signal or the like to the head cartridge 201 via theabove-described connector. A reference numeral 203 indicates a guideshaft. The carriage 202 is designed so as to be capable of reciprocatingalong the guide shaft 203. Specifically, the carriage 202 is driven viadrive mechanisms, such as a motor pulley 205, a driven pulley 206, and atiming belt 207, by using a main scan motor 204 as a drive source and atthe same time, the position and movement of the carriage 202 arecontrolled. The movement of the carriage along the guide shaft 203 isreferred to as a “main scan” and the direction of the movement isreferred to as a “main scanning direction”.

A printing medium 208, such as a printing sheet, is mounted on an autosheet feeder 210 (hereinafter, described as ASF). In the case where theimage forming apparatus 200 outputs an image, a pickup roller 212rotates via a gear due to the drive of a paper feed motor 211 and paperis fed one by one from the ASF 210 separately. Further, the printingmedium 208 is conveyed to an image formation start position inopposition to the ejection port surface of the head cartridge 201 on thecarriage 202 due to the rotation of a conveyance roller 209. Theconveyance roller 209 is driven via a gear using a line feeder (LF)motor 213 as a drive source. Determination of whether the printingmedium 208 has been fed and the settlement of the cueing position at thetime of paper feed of the printing medium 208 are performed at the pointin time of passing of the printing medium 208 by a paper end sensor 214.The head cartridge 201 mounted on the carriage 202 is held so that theejection port surface protrudes downward from the carriage 202 andbecomes parallel to the printing medium 208. The control unit 220includes a CPU, a storage device, etc., and the image forming apparatus200 receives image data and roughness shape data supplied from theoutside, such as the host 100, and controls the operation of each partof the image forming apparatus 200 based on the received data. It can besaid that the roughness shape data of the present embodiment is anaspect of information representing a roughness shape. As describedabove, the configuration example of the image forming apparatus 200 ofthe present embodiment is explained, but a configuration other than theabove-described ink jet printer may be accepted as long as it ispossible to form a roughness layer and an image layer by using aplurality of printing materials.

<Image Forming Operation>

Next, the image forming operation in the image forming apparatus 200 inFIG. 3 is explained. First, in the case where the printing medium 208 isconveyed to a predetermined printing start position, the carriage 202moves on the printing medium 208 along the guide shaft 203 and inks areejected from the ejection ports of the print head during the movement.Then, in the case where the carriage 202 moves up to one end of theguide shaft 203, the conveyance roller 209 conveys the printing medium208 in the direction perpendicular to the scanning direction of thecartridge 202 by a predetermined amount. This conveyance of the printingmedium 208 is referred to as “paper feed” or “sub scan” and theconveyance direction is referred to as the “paper feed direction” or the“sub scanning direction”. In the case where the conveyance of theprinting medium. 208 by the predetermined amount is completed, thecarriage 202 moves again along the guide shaft 203. By repeating scanand paper feed by the carriage 202 of the print head in this manner, animage is formed on the entire printing medium 208.

FIG. 4 is a diagram showing an operation example to form a roughnesslayer and an image layer by the print head scanning twice on the sameline of the printing medium 208 in the image forming apparatus 200 inthe present embodiment. Here, an example is explained in which half ofthe print head with a width L (L/2) is used for forming a roughnesslayer and the remaining half is used for forming an image layer and eachtime one-time scan is completed, the printing medium 208 is conveyed inthe sub scanning direction by a distance L/2 each time. The number ofarranged ink tanks of liquid resin ink, which are mounted on the headcartridge 201, is large compared to the number of color material inktanks. First, in an mth scan, a roughness layer is formed by ejectingthe liquid resin ink in an area A of the printing medium 208. Next, inan (m+1)th scan, a roughness layer is formed by ejecting the liquidresin ink in an area B of the printing medium 208 and at the same time,an image layer is formed by ejecting a plurality of color material inksin the area A on the roughness layer formed in the mth scan. The imageforming apparatus 200 forms the roughness layer and the image layer onthe printing medium 208 by repeating the above-described operation. Inthe present embodiment, the roughness layer and the image layer areformed by performing the scan twice, but the present embodiment is notlimited to this. For example, it may also be possible to performsuperimposed printing by repeating the main scan a plurality of times inorder to form the roughness layer in the area A of the printing medium208. In the present embodiment, the kind of the printing medium 208 isnot limited in particular and it is possible to use various kinds ofmaterial, such as paper and a plastic film, as long as they arecompatible with image formation by the image forming apparatus 200.

<Roughness Shape>

FIG. 5 is a diagram showing an example of a stacked layer section of theroughness layer and the image layer formed on the printing medium 208 bythe image forming apparatus 200 performing the image forming operationin FIG. 4. As shown in FIG. 5, the roughness layer of the presentembodiment is normally formed so as to be distributed with a height ofabout several mm. On the other hand, the image layer is formed so as tobe distributed with a height of several μm. In the present embodiment,the image layer is formed on the roughness layer. Regarding this point,to be strict, the image layer has a height distribution different in arange of several μm, but in view of the proportion of the image layer tothe stacked layer of the roughness layer and the image layer, a heightof about several μm can be ignored. Because of this, in the presentembodiment, only the height distribution of the roughness layer is takeninto consideration. Of course, it may also be possible to take intoconsideration the height distribution of the image layer. In the presentembodiment, the shape formed by the roughness layer or the roughnesslayer and the image layer is referred to as the “roughness shape”.

<Range of Roughness Shape that can be Output>

In the case where the image forming apparatus 200 forms a roughnessshape based on the roughness shape data the input of which has beenreceived, the roughness shape that can be output depends on, forexample, the surface tension characteristics and the wetting spreadingcharacteristics of ink, or the size of the image forming apparatus 200itself and the output characteristics, such as the resolution that canbe output.

FIG. 6 is a schematic diagram showing output conditions of the imageforming apparatus 200 in the present embodiment. In a graph 500 in FIG.6, the frequency is associated with the horizontal axis and theamplitude with the vertical axis.

The above-described frequency is an index for comparing the cycle of theconvex portion and the concave portion in the roughness shape and inthis example, the cycle of the convex portion and the concave portion inthe spatial frequency per mm is used. Although details will be describedlater, in the present embodiment, a frequency F of the roughness shapeis calculated from the height distribution of the roughness shape and bycomparing the frequency F with the frequency of the graph 500, whetherthe roughness shape is within the output possible range of the imageforming apparatus 200 is determined.

A frequency upper limit 510 indicates the upper limit of the frequencyat which it is possible for the image forming apparatus 200 to form aroughness shape with a high reproducibility and as a value that thefrequency upper limit 510 of the present embodiment can take, 11.8cycle/mm is shown as an example. This indicates that it is no longerpossible for the image forming apparatus 200 to form a roughness shapewith a high reproducibility in the case where the bottom area of theconvex portion and the concave portion exceeds about 42 μm (i.e., 84 μmper cycle). Here, 42 μm corresponds to the size of one pixel of 600 dpi.

The above-described amplitude is an index for comparing the height ofthe roughness shape and in this example, mm (millimeter) is used.Although details will be described later, in the present embodiment, aheight maximum value H of the roughness shape is acquired from theheight distribution of the roughness shape and by comparing the heightmaximum value H with the amplitude of the graph 500, whether theroughness shape is within the output possible range of the image formingapparatus 200 is determined.

An amplitude upper limit 520 indicates the upper limit of the amplitudeat which it is possible for the image forming apparatus 200 to form aroughness shape with a high reproducibility, and as a value that theamplitude upper limit 520 of the present embodiment can take, 2 mm isshown as an example. This indicates that it is no longer possible forthe image forming apparatus 200 to form a roughness shape with a highreproducibility in the case where the height of the convex portionexceeds about 2 mm.

An output possible range 530 indicates a range in which it is possiblefor the image forming apparatus 200 to form a roughness shape with ahigh reproducibility. That is, for the roughness shape datacorresponding to the output possible range 530, it is possible for theimage forming apparatus 200 to form an output that reproduces theroughness shape specified by the roughness shape data. The outputpossible range 530 of the present embodiment corresponds to an areadefined by an arc connecting the “vertical axis: amplitude 2 mm” and the“horizontal axis: 11.8 cycle/mm”. The frequency and the amplitude are ina mutual-dependence relationship. For example, for a high-frequencyroughness shape, the cycle of the concave portion and the convex portionbecomes high, and therefore, it becomes difficult to output a roughnessshape having a sharp angle in the convex portion the amplitude of whichhas a height higher than or equal to a fixed height in view of thewetting spreading characteristics of ink or the like. On the contrary,for a roughness shape with a large amplitude, a bottom area of theconvex portion in accordance with the height is necessary in view of thewetting spreading characteristics of ink or the like, and therefore, thefrequency is limited accordingly. The arc that defines the outputpossible range 530 results from the above-described mutual-dependencerelationship between the frequency and the amplitude.

A texture maintaining range 540 indicates a range in which it ispossible for the image forming apparatus 200 to reproduce the texture ofthe roughness shape specified by the roughness shape data by the host100 correcting the roughness shape data. To the texture maintainingrange 540 of the present embodiment, an area defined by an arcconnecting the “vertical axis: amplitude 10 mm” and the “horizontalaxis: 94.5 cycle/mm” corresponds. There is an area that is outside theoutput possible range 530 even though the frequency upper limit 510 andthe amplitude upper limit 520 of the image forming apparatus 200 aresatisfied. For this area, it is possible to cause the image formingapparatus 200 to output a structure with a higher reproducibility bycorrecting the roughness shape data. For the roughness shape dataincluded in the texture maintaining range 540 although the frequencyupper limit 510 and the amplitude upper limit 520 are not satisfied, itis not possible to cause the image forming apparatus 200 to output astructure unless some steps are taken. However, by correcting theroughness shape data included in the texture maintaining range 540 suchas this, it is possible to cause the image forming apparatus 200 tooutput a structure that is an approximation of the roughness shaperepresented by the roughness shape data.

In the present embodiment, the host (image processing apparatus) 100compares the height distribution of the roughness shape and the outputconditions (the frequency upper limit 510, the amplitude upper limit520, the output possible range 530, the texture maintaining range 540).Even in the case where the roughness shape data not included in theoutput possible range 530 is input as the results of the comparison, theroughness shape data is corrected on a condition that the roughnessshape data is included within the texture maintaining range 540. Due tothis, it is possible for the image forming apparatus 200 to output aroughness shape in which a desired texture is maintained. Each numericalvalue described above is an example and the numerical value is notlimited to the illustrated numerical value.

<Function Block>

FIG. 7 is a block diagram showing a function configuration of the imageforming system 1 in the present embodiment. The image forming system 1includes an image data input reception unit 601, a roughness shape datainput reception unit 602, an output condition acquisition unit 603, animage processing unit 604, a roughness shape analysis unit 605, aroughness shape correction unit 606, an output unit 607, and the imageforming apparatus 200.

The image data input reception unit 601 temporarily stores the imagedata the input from a user of which has been received via the input unit103 or the like in the memory 102 or the external storage device 104.The image data is data that is referred to in the case where the imagelayer shown in FIG. 5 is formed and is converted into image data thatcan be output by the image forming apparatus 200 by the image processingunit 604, to be described later. Similarly, the roughness shape datainput reception unit 602 temporarily stores the roughness shape data theinput from a user of which has been received via the input unit 103 orthe like in the memory 102 or the external storage device 104. Theroughness shape data is data that is referred to in the case where theroughness layer shown in FIG. 5 is formed and includes various kinds ofinformation specifying the roughness shape, which is a three-dimensionalshape. In the present embodiment, an example is explained in which theimage data and the roughness shape data are received as inputs ofdifferent pieces of data, but in the image data, for example,information specifying the roughness shape may be included. In thiscase, it is possible for the image forming system. 1 to form the imagelayer and the roughness layer by referring to the single image data.

The output condition acquisition unit 603 acquires the output conditionsin the case where the image forming apparatus 200 forms an image on theprinting medium 208. In the present embodiment, the output conditionscorrespond to the frequency upper limit 510, the amplitude upper limit520, the output possible range 530, and the texture maintaining range540. Further, the setting of the kind of paper to be used to form animage, the output setting of the image processing condition in the imageprocessing unit 604 are also included in the output conditions of thepresent embodiment.

The image processing unit 604 calls the image data temporarily stored bythe image data input reception unit 601 and performs various kinds ofimage processing. More specifically, the image processing unit 604performs color conversion processing, halftone processing, etc., for theimage data, and thus converts the image data into image data that can beoutput by the image forming apparatus 200.

The roughness shape analysis unit 605 calls the roughness shape datatemporarily stored by the roughness shape data input reception unit 602and analyzes the roughness shape data. Details of the procedure by theroughness shape analysis unit 605 will be described later. The roughnessshape correction unit 606 performs processing to correct the roughnessshape data in accordance with the output conditions acquired by theoutput condition acquisition unit 603 and the analysis results of theroughness shape analysis unit 605. Details of the procedure by theroughness shape correction unit 606 will be described later.

The output unit 607 transmits the image data that the image processingunit 604 outputs and the roughness shape data that the roughness shapecorrection unit 606 outputs to the image forming apparatus 200. Theimage forming apparatus 200 outputs a roughness shape and an image ontothe printing medium 208 by performing the image forming operation shownin FIG. 4 and ejecting each printing material based on the image dataand the roughness shape data received from the output unit 607.

<Processing Flowchart>

FIGS. 8A and 8B are flowcharts showing procedure performed by the imageforming system 1 of the present embodiment. Hereinafter, with referenceto the flowcharts in FIGS. 8A and 8B, the procedure of the correctionprocessing of roughness shape data and the procedure of the imageforming processing are explained, respectively. Reference letter Sdescribed below means the step in the flowchart and the processing inthe flowcharts shown in FIGS. 8A and 8B is performed by the program codestored in the external storage device 104 being developed onto thememory 102 and executed by the CPU 101. Further, in the flowcharts inFIGS. 8A and 8B, S701 is performed by the image data input receptionunit 601, S702 is performed by the roughness shape data input receptionunit 602, and S703 is performed by the output condition acquisition unit603. Furthermore, S704 is performed by the image processing unit 604 andS705 is performed by the roughness shape analysis unit 605. S706 to S711are performed by the roughness shape correction unit 606 and S712 isperformed by the image forming apparatus 200.

At S701, the image data input reception unit 601 receives an input ofimage data. In the present embodiment, as in the prior art, the imagedata to be input is image data specifying each value of R (red), G(green), and B (blue) at two-dimensional coordinates (x, y) on thesurface of the printing medium. 208, but the present embodiment is notlimited to this. For example, image data specifying each value of C(cyan), M (magenta), Y (yellow), and K (black) may be input.

At S702, the roughness shape data input reception unit 602 receives aninput of roughness shape data. The roughness shape data includestwo-dimensional coordinates (x, y) corresponding to the roughness shapeto be formed on the printing medium 208 and information specifying theheight at each coordinates. It is possible for the roughness shapeanalysis unit 605 and the roughness shape correction unit 606 to specifythe height of the roughness shape corresponding to the two-dimensionalcoordinates by referring to the roughness shape data.

At S703, the output condition acquisition unit 603 acquires the outputconditions. In the present embodiment, the output condition acquisitionunit 603 acquires the output setting to be referred to at S704 and theoutput conditions, such as the output possible range 530, explained inFIG. 6. In the present embodiment, inputs of the output setting and theoutput conditions are received from a user via the input unit 103, butan aspect may be accepted in which values set in advance in the imageforming system 1 are referred to as the output setting and the outputconditions. Further, an aspect may be accepted in which the outputconditions are acquired from an information processing apparatusexternally connected via a network I/F (not shown) included in the host100. Furthermore, an aspect may be accepted in which the host 100acquires the output conditions by the output conditions held by thecontrol unit 220 of the image forming apparatus 200 being transmitted tothe host 100 in response to the establishment of the connection betweenthe host 100 and the image forming apparatus 200 via the printer I/F105.

At S704, the image processing unit 604 performs image processing for theimage data the input of which has been received at S701. Specifically,the image processing unit 604 performs various kinds of image conversionprocessing for the image data. In the present embodiment, the imageprocessing unit 604 performs image processing, for example, colorconversion processing, halftone processing, etc., for the image data theinput of which has been received. In more detail, the color conversionprocessing converts RGB image data the input of which has been receivedinto image data of a plurality of color inks mounted on the imageforming apparatus 200, for example, image data of CMYK. The colorconversion processing is performed by using a color conversion tablegenerally called an LUT (lookup table). The halftone processing convertsimage data of CMYK converted in the color conversion processing intobinary halftone image data in which each color ink is ejected or not byusing binarization processing, such as the error diffusion method. Theconverted binary halftone image data of each color is output to theimage forming apparatus 200 by the output unit 607.

At S705, the roughness shape analysis unit 605 performs analysisprocessing for the roughness shape data the input of which has beenreceived at S702. Specifically, the roughness shape analysis unit 605acquires a histogram of the height distribution of the roughness shapespecified by the roughness shape data from the roughness shape data andcalculates the maximum value, the minimum value, and the difference ofelevation, respectively, of the height distribution of the roughnessshape by referring to the acquired histogram. Further, the roughnessshape analysis unit 605 also calculates the frequency F of the heightdistribution by frequency-converting the acquired height distribution ofthe roughness shape in addition to the calculation of the maximum value,the minimum value, and the difference of elevation of the heightdistribution. In the present embodiment, the frequency conversion firstapplies a method, such as the two-dimensional Fourier transformation, tothe height distribution of the roughness shape. In the data after thefrequency conversion, an average value of intensity in thecircumferential direction, which is the same frequency, is calculatedand the intensity of each frequency is derived. Further, among thecalculated intensities for each frequency, the frequency having thehighest value is taken to be the frequency F of the height distribution.The method is not limited to this method provided that it is possible tospecify a dominant frequency component in the height distribution. Itmay also be possible to simply take the frequency whose intensity is themaximum to be F without calculating an average in the circumferentialdirection or to take an average value in the entire frequency band to beF by multiplying the intensity for each frequency by a weight.

FIG. 9 is a diagram showing an example of the histogram of the heightdistribution of a roughness shape. In the histogram in FIG. 9, thehorizontal axis represents the height of the roughness shape and thevertical axis represents the number of pixels corresponding to theheight of the roughness shape. A distribution curve 801 represents adistribution of the number of pixels corresponding to the height of theroughness shape. On the distribution curve 801, a point P indicates aheight maximum value H of the roughness shape. On the distribution curve801, a point Q indicates a height minimum value L of the roughnessshape. A difference of elevation G between the height maximum value Hand the height minimum value L corresponds to a difference value betweenthe value of the point P and the value of the point Q. It is possiblefor the roughness shape analysis unit 605 to find the height maximumvalue H, the height minimum value L, the difference of elevation G, andthe frequency F in the height distribution of the roughness shape byanalyzing the roughness shape data at S705.

At S706 to S715, the roughness shape correction unit 606 determines acorrection method of the roughness shape data in the case where theroughness shape data is determined to be outside the output possiblerange 530 by the output conditions acquired at S703 and the analysisresults at S705.

At S706, the roughness shape correction unit 606 determines whether theroughness shape analyzed at S705 is within the texture maintainingrange. In the case where the roughness shape is determined to be withinthe texture maintaining range 540 (S706: YES), the processing moves toS707. On the other hand, in the case where the roughness shape isdetermined to be outside the texture maintaining range (S706: NO), thisflowchart is terminated without the output unit 607 transmitting theimage data and the roughness shape data to the image forming apparatus200. At this time, it may also be possible to cause the monitor 110 todisplay an error message via the video I/F 106.

At S707, the roughness shape correction unit 606 determines whether theroughness shape analyzed at S705 is within the output possible range. Inthe case where the roughness shape is determined to be within the outputpossible range (S707: YES), the processing moves to S715. On the otherhand, in the case where the roughness shape is not determined to bewithin the output possible range 530 (S707: NO), the processing moves toS708.

At S708, the roughness shape correction unit 606 determines whether theheight maximum value H of the roughness shape is less than or equal tothe amplitude upper limit. In the case where the height maximum value His less than or equal to the amplitude upper limit 520 (S708: YES), theprocessing moves to S709 and in the case where the height maximum valueH is greater than the amplitude upper limit 520 (S708: NO), theprocessing moves to S710.

At S709, the roughness shape correction unit 606 determines whether thefrequency F is less than or equal to the frequency upper limit. In thecase where the frequency F is less than or equal to the frequency upperlimit 510 (S709: YES), the processing moves to S711. In the case wherethe frequency F is higher than the frequency upper limit 510 (S709: NO),the processing moves to S712.

At step S710, the roughness shape correction unit 606 determines whetherthe frequency F is less than or equal to the frequency upper limit 510.In the case where the frequency F is less than or equal to the frequencyupper limit 510 (S710: YES), the processing moves to S713 and in thecase where the frequency F is higher than the frequency upper limit 510(S710: NO), the processing moves to S714.

At S711, the roughness shape correction unit 606 performs frequencycorrection or amplitude correction for the roughness shape data. Forexample, it is possible for the roughness shape correction unit 606 tocalculate amounts of correction with which the height maximum value Hand the frequency F take values that fall within the output possiblerange 530, respectively, and to select a correction method with asmaller amount of correction. Details of the frequency correction andthe frequency correction will be described later. After the correctionprocessing for the roughness shape data is completed (S711), theprocessing moves to S715.

At step S712, the roughness shape correction unit 606 performs thefrequency correction for the roughness shape data the input of which hasbeen received at S702. FIG. 10 is a flowchart showing details of theprocedure of the frequency correction (S712). At S1001, the roughnessshape correction unit 606 performs smoothing processing for theroughness shape data. In the present embodiment, for example, byperforming a convolution operation of the roughness shape data with atwo-dimensional low-pass filer having low-frequency characteristics, thesmoothing process of the roughness shape data is performed. Theroughness shape correction unit 606 corrects the roughness shape data sothat the frequency F becomes a value within the output possible range530 by the smoothing correction (S1001).

FIGS. 11A to 11C are schematic diagrams showing a transition of aroughness shape before and after the frequency correction. FIG. 11Ashows an example of a roughness shape 1101 specified by the roughnessshape data before the smoothing processing and FIG. 11B shows an exampleof a roughness shape 1102 specified by the roughness shape data afterthe smoothing processing. As shown in FIGS. 11A and 11B, in thesmoothing processing of the present embodiment, by the roughness portionof the roughness shape 1101 being smoothed, the contour of the peripheryof the convex portion of the roughness shape 1102 makes a transitioninto a smooth shape.

At step S1002, the roughness shape correction unit 606 performs heightrestoration processing to restore the height reduced by the smoothingcorrection (S1001) for the roughness shape data. In the presentembodiment, it may also be possible to perform the height restorationprocessing by, for example, multiplying the height in the heightdistribution of the roughness shape by a fixed coefficient. Further, itmay also be possible to perform the height restoration processing bycalling a coefficient corresponding to each height of the roughnessshape from an LUT and by carrying out one-dimensional LUT conversion ofthe height of the roughness shape. The roughness shape correction unit606 corrects the roughness shape data so that the height maximum value His restored to the value of the height maximum value H of the roughnessshape 1101 by the height restoration processing (S1002).

Returning to FIGS. 11A to 11C again, an example of a roughness shape1103 specified by the roughness shape data after the height restorationprocessing is shown in FIG. 11C. In the height restoration processing ofthe present embodiment, the multiplication of a coefficient orone-dimensional LUT conversion is performed for each height of theroughness shape 1102. Due to this, as shown in FIGS. 11B and 11C, theheight maximum value H of the roughness shape 1103 is restored to thesame value as the height maximum value H of the roughness shape 1101. Inthis manner, by the smoothing processing and the height restorationprocessing being performed in the frequency correction (S712), it ispossible to correct the roughness shape data to roughness shape datathat can be output by the image forming apparatus 200 while maintainingthe texture of the roughness shape.

At step S713, the roughness shape correction unit 606 performs theamplitude correction for the roughness shape data the input of which hasbeen received at S702. FIG. 12 is a flowchart showing detailed procedureof the amplitude correction (S713). At S1101, the roughness shapecorrection unit 606 performs height subtraction processing for theroughness shape data. In the present embodiment, the roughness shapecorrection unit 606 first acquires each height of the roughness shape.Next, the roughness shape correction unit 606 performs processing tosubtract the height minimum value L (FIG. 9) from each acquired height.The roughness shape correction unit 606 corrects the roughness shapedata by the height subtraction processing (S1101) so that the heightminimum value L of the roughness shape is subtracted while thedifference of elevation G of the roughness shape is maintained.

FIGS. 13A and 13B are schematic diagrams showing a transition of aroughness shape before and after the height subtraction processing. FIG.13A shows an example of a roughness shape 1301 specified by theroughness shape data before the height subtraction processing and FIG.13B shows an example of a roughness shape 1302 specified by theroughness shape data after the height subtraction processing. As shownin FIGS. 13A and 13B, in the height subtraction processing of thepresent embodiment, the height minimum value L is subtracted from eachheight of the roughness shape. Because of this, while the height maximumvalue H is corrected to the height maximum value H′ within the amplitudeoutput range, the difference of elevation G is kept at the same valuebefore and after the height subtraction processing. As described above,by the height subtraction processing, it is possible to correct theroughness shape data to data that can be output by the image formingapparatus 200 while maintaining the texture of a roughness shape.

At S1102, the roughness shape correction unit 606 determines whether theheight maximum value H′ after the height subtraction processing iswithin the output possible range 530. In the case where the heightmaximum value H′ is within the output possible range 530 (S1102: YES),it is made possible for the image forming apparatus 200 to output theroughness shape 1302 after the height subtraction processing, andtherefore, the amplitude correction of the roughness shape data (S713)is terminated, and the processing moves to S715. In the case where theheight maximum value H′ is outside the output possible range 530 (S1102:NO), it is not possible for the image forming apparatus 200 to outputthe roughness shape 1302 after the height subtraction processing, andtherefore, the processing moves to S1103 so that further correction isperformed for the roughness shape data.

At S1103, the roughness shape correction unit 606 performs reductionprocessing for the roughness shape data after the height subtractionprocessing. In the present embodiment, the roughness shape correctionunit 606 first acquires each height of the roughness shape after theheight subtraction processing. Next, the roughness shape correction unit606 calculates a reduction ratio coefficient so that the height maximumvalue H′ after the height subtraction processing becomes a value withinthe output possible range 530. Next, the roughness shape correction unit606 performs processing to multiply each height of the roughness shapeby the reduction ratio coefficient.

FIGS. 14A to 14C are schematic diagrams showing a transition of aroughness shape during the reduction processing (S1103) and sharpeningprocessing (S1104). FIG. 14A shows an example of a roughness shape 1401specified by the roughness shape data before the reduction processingand FIG. 14B shows an example of a roughness shape 1402 specified by theroughness shape data after the reduction processing. As shown in FIGS.14A and 14B, in the reduction processing of the present embodiment, thereduction ratio coefficient is applied to each height of the roughnessshape 1401. Consequently, the height maximum value H is corrected to theheight maximum value H′ within the output possible range 530.

At S1104, the roughness shape correction unit 606 performs thesharpening processing for the roughness shape data after the reductionprocessing. In the present embodiment, the roughness shape correctionunit 606 performs, for example, unsharp mask processing for theroughness shape data after the reduction processing. By performing theunsharp mask processing for the roughness shape data after the reductionprocessing, the convex portion in the roughness shape becomes a sharpshape.

Returning to FIGS. 14A to 14C again, FIG. 14C shows an example of aroughness shape 1403 specified by the roughness shape data after thesharpening processing. In the sharpening processing of the presentembodiment, the unsharp mask processing is performed for the roughnessshape data after the reduction processing. By the above-describedprocessing, the shape of the periphery of the convex portion of theroughness shape 1403 becomes a sharp shape and on the other hand, theheight maximum value H′ and the difference of elevation G are kept atthe same values before and after the sharpening processing. As describedabove, by the reduction processing and the sharpening processing, it ispossible to correct the roughness shape data to data that can be outputby the image forming apparatus 200 while maintaining the texture of theroughness shape.

Returning to FIGS. 8A and 8B again, at S714, the roughness shapecorrection unit 606 performs amplitude/frequency correction for theroughness shape data received at S702. FIG. 15 is a flowchart showingdetailed processing of the amplitude/frequency correction (S714). AtS1201, the roughness shape correction unit 606 performs the heightsubtraction processing for the roughness shape data. The heightsubtraction processing is the same as the height subtraction processing(S1101) explained in FIG. 12.

At S1202, the roughness shape correction unit 606 determines whether theheight maximum value H′ after the height subtraction processing iswithin the amplitude upper limit 520. In the case where the heightmaximum value H′ is within the amplitude upper limit 520 (S1202: YES),the processing moves to S1203 and the roughness shape correction unit606 performs the frequency correction for the roughness shape data.

In the case where the height maximum value H′ is outside the amplitudeupper limit 520 (S1202: NO), the processing moves to S1204 and theroughness shape correction unit 606 performs the reduction processingfor the roughness shape data. The reduction processing is the same asthe reduction processing (S1103) explained in FIG. 12. Next, at S1205,the roughness shape correction unit 606 performs the sharpeningprocessing for the roughness shape data. The sharpening processing isthe same as the sharpening processing (S1104) explained in FIG. 12.Next, at S1206, the roughness shape correction unit 606 performs thefrequency correction for the roughness shape data. In the frequencycorrection at S1203 and S1205, the same processing as the roughnessshape data frequency correction (FIGS. 8A and 8B, S712) is performed.

Returning to FIGS. 8A and 8B again, at S715, the image forming apparatus200 receives binary halftone image data of each color and the roughnessshape data after the correction from the output unit 607. The imageforming apparatus 200 outputs an image layer from the binary halftoneimage data of each color and a roughness layer from the roughness shapedata after the correction, respectively. The image forming apparatus 200in the present embodiment outputs a three-dimensional shape image on theprinting medium 208 by the image forming operation explained in FIG. 3and FIG. 4. At this time, the roughness layer is formed first on theprinting medium 208 and then the image layer is printed on the top ofthe formed roughness layer.

As above, the image processing apparatus of the present embodimentcorrects roughness shape data so that the image forming apparatus 200can stably produce an output while maintaining the texture of aroughness shape corresponding to the roughness shape data in accordancewith the output conditions of the image forming apparatus 200. Due tothis, it is possible for the image forming apparatus 200 to increase thereproducibility of the texture of the roughness shape corresponding tothe roughness shape data. Further, by performing the correctionprocessing of the roughness shape data according to the presentembodiment, it is possible to extend the range of the roughness shapedata in which the image forming apparatus 200 can reproduce a texture.The reason is that in the case where roughness shape data exceeding theoutput possible range of the image forming apparatus 200 is input, it ismade possible to output a roughness shape with a desired texture beingmaintained by correcting the roughness shape data in accordance with thecharacteristics of the roughness shape. Because of this, even forroughness shape data in a range with which the image forming apparatus200 is not compatible originally, it is possible to output an image inwhich the texture of a three-dimensional shape desired by a user isreproduced.

In the explanation of the present embodiment, the aspect is illustratedin which the ink jet image forming apparatus 200 performs printingdirectly on the printing medium 208, but the present embodiment is notlimited to this. For example, it is also possible to apply the presentembodiment by a method in which the image forming apparatus 200 onceperforms printing on a film or the like and the printed film or the likeis pasted to a wood material or a wall surface. In the explanation ofthe present embodiment, it is explained that the height of the roughnesslayer is about several mm, but the height of the roughness layer is notlimited to this. It is possible to apply the present embodiment to aroughness shape having any size and shape. Further, in the explanationof the present embodiment, the aspect is explained in which the imageforming system 1 receives the input of roughness shape data, but thepresent embodiment is not limited to this. What is required is theability to acquire information for specifying a roughness shape and itis also possible to estimate a roughness shape from image data and togenerate roughness shape data from the estimation results.

Second Embodiment

In the present embodiment, an aspect is explained in which roughnessshape data the input of which has been received is divided into aplurality of areas and the correction explained in the first embodimentis performed for the divided roughness shape data. In the explanation ofthe present embodiment, the same reference letters or numerals areattached to the same configurations as those of the first embodiment andexplanation of duplicated contents is omitted.

FIG. 16 is a flowchart showing a procedure performed by the imageforming system 1 of the present embodiment. In the flowchart shown inFIG. 16, the processing at S701 to S704 is the same as that of the firstembodiment, and therefore, explanation thereof is omitted. At S1501, theroughness shape data the input of which has been received at S702 isdivided into a plurality of areas. FIG. 17 is a diagram showing anexample in which roughness shape data in two-dimensional coordinates (x,y) is divided into a plurality of areas. In the present embodiment, theroughness shape data shown in FIG. 17 consists of (number I of pixels inx-axis direction)×(number J of pixels in y-axis direction) and isdivided into I×J areas, i.e., 36 areas in total. In the presentembodiment also, the roughness shape data includes the two-dimensionalcoordinates (x, y) corresponding to a roughness shape to be formed onthe printing medium 208 and information specifying the height at eachcoordinates.

At S705, the roughness shape analysis unit 605 performs analysisprocessing for the roughness shape data in each divided area divided atS1501. As the results of the analysis processing, as in the firstembodiment, the maximum value, the minimum value, and the difference ofelevation in the height distribution in each divided area and thefrequency are calculated. Next, at S1502, the roughness shape correctionunit 606 calculates a weight coefficient of each divided area based onthe analysis results of each area calculated at S705. Specifically, theweight coefficient of each divided area is calculated by using theheight maximum value H calculated for each divided area. The largestvalue among height maximum values Hv (v=1, 2, . . . , 36) is taken to beHv_max and the weight coefficient of the divided area with Hv_max istaken to be 1. The weight coefficient of a divided area other than thedivided area with Hv_max is calculated by dividing the height maximumvalue Hv by Hv_max.

At S1503, the roughness shape correction unit 606 performs correctionfor the roughness shape data of each divided area. As in the firstembodiment, for the roughness shape data of each divided area, thedetermination of whether the roughness shape data is within the outputpossible range (S706 to S707 in FIGS. 8A and 8B), the determination ofthe correction method (S708 to S710 in FIGS. 8A and 8B), and thecorrection processing (S711 to S714 in FIGS. 8A and 8B) are performed.

At S1504, the roughness shape correction unit 606 adjusts a deviation inthe distribution of the height specified by the roughness shape data ofeach divided area by using the corrected roughness shape data of eachdivided area and the weight coefficient of each divided area calculatedat S1502. Specifically, by multiplying the corrected roughness shapedata of each divided area by the weight coefficient, the deviation inthe distribution of the height specified by the roughness shape data ofeach divided area is adjusted. At S715, the image forming apparatus 200outputs a three-dimensional shape image on the printing medium 208 basedon the image data for which the processing at S704 has been performedand the roughness shape data for which the processing at S1503 and S1504has been performed.

As explained above, the image processing apparatus of the presentembodiment divides the roughness shape data the input of which has beenreceived into a plurality of areas and performs correction for eachpiece of the roughness shape data adjusted by the weight coefficient ofeach divided area. Due to the configuration such as this, it is possibleto correct roughness shape data so as to obtain a preferred roughnessshape on the whole even in the case where, for example, only a part ofthe roughness shape is extremely high, in the case where only a part ofthe roughness shape is extremely low, or in the case of the roughnessshape in which areas having different frequencies exit mixedly. Becauseof this, even in the case where roughness shape data exceeding theoutput possible range of the image forming apparatus 200 is input, it ispossible to output a roughness shape maintaining a desired texture bycorrecting the roughness shape data by a correction method in accordancewith the roughness shape.

Third Embodiment

In the above-described embodiments, explanation is given as to themethod of correcting roughness shape data in the case where it ispossible to maintain a desired texture by correcting the roughness shapedata in accordance with the characteristics of the roughness shape. Asdescribed previously, the output by the image forming apparatus 200 isaffected by the wetting spreading characteristics of ink or the like,and therefore, in the case where the roughness shape of an object to bereproduced has sharp shade, there is a possibility that the sharpness islost. In the present embodiment, explanation is given as to a method ofincreasing a texture of a roughness shape of a structure that is outputby the image forming apparatus 200 by controlling the color of an imagelayer to be formed on a roughness layer based on the appearance of theroughness shape output by the image forming apparatus 200 withoutperforming correction for the roughness shape data. In the explanationof the present embodiment, the same reference letters or numerals areattached to the same configurations as those of the above-describedembodiments and explanation of duplicated contents is omitted.

FIG. 18 is a flowchart showing a procedure performed by the imageforming system 1 of the present embodiment. In the flowchart shown inFIG. 18, the processing other than the processing at S1801 is the sameas that of the first embodiment, and therefore, explanation is omitted.At S1801, the image processing unit 604 acquires image data and performscorrection processing for the image data in order to print an image on aroughness layer formed based on roughness shape data.

FIG. 21 is a diagram schematically showing a part of a roughness shapecorresponding to roughness shape data. In the three-dimensional (xyz)space in FIG. 21, the xy-plane specified by the x axis and the y axiscorresponds to the surface of the printing medium 208 and a valuespecified by the z axis corresponds to the height H of a roughness shape2001. It is assumed that the roughness shape 2001 has no inclination inthe y-axis direction. In the roughness shape 2001, z gradually increasesas x changes from 0 to 10 and z is constant with respect to y, andtherefore, the roughness shape 2001 includes a plane 2003 in which theangle does not change. Similarly, in the roughness shape 2001, zgradually decreases as x changes from 10 to 20 and z is constant withrespect to y. In the present embodiment, it is difficult to reproducesuch a roughness shape itself. Consequently, in the present embodiment,in order to represent the texture of the roughness shape 2001, the imagedata representing the image layer is corrected in accordance theappearance of the roughness shape 2001.

It is assumed that the observation conditions of the roughness shape2001 are that the incidence angle θ=6 degrees and the rotation angle φ=0degrees. That is, it is desirable for a structure obtained from theimage forming apparatus 200 to be capable of reproducing the roughnessshape corresponding to the roughness shape data in the case where thestructure is observed under the specified observation conditions. Underthese observation conditions, light illuminates the roughness shape 2001from a light source 2002 and the normal of the plane 2003 agrees withthe illumination direction from the light source 2002, and it is assumedthat the illuminance on the plane 2003 due to the light source 2002 is100% (this means the illuminance in the case where the illuminationdirection and the normal agree with each other). On the other hand, asshown by the schematic diagram in FIG. 21, the illumination light fromthe light source 2002 is illuminated to a plane 2004 obliquely, andtherefore, compared to the illuminance on the plane 2003, theilluminance per unit area on the plane 2004 is relatively low.

FIGS. 22A to 22F are diagrams explaining reproduction of a roughnessshape. FIGS. 22A and 22B are each a section diagram of a roughnessshape. The horizontal axis represents the value of the x axis in thecase where the surface of the printing medium 208 on which a roughnesslayer is formed is taken to be the xy-plane and the vertical axisrepresents the height. FIG. 22A shows the height distribution of inputroughness shape data. FIG. 22B shows the height distribution of theresults of the image forming apparatus 200 outputting a resin printingmaterial and forming a structure based on the input roughness shapedata. In FIG. 22A, a graph line 2101 of the height distribution of theinput roughness shape data represents a sharp change in angle at x=10mm. From this, it is known that the roughness shape specified by theroughness shape data of an object to be reproduced is originally aroughness shape having a sharp convex portion). In FIG. 22B, a graphline 2102 representing the height distribution of a structure is asmooth curve at x=10 mm. This means that it was not possible for theimage forming apparatus 200 to actually produce a sharp convex portiondue to the characteristics of the resin printing material and thegeneration process.

FIGS. 22C and 22D are diagrams explaining the appearance of theroughness shape. FIG. 22C shows an illuminance distribution 2103 of theroughness shape represented by the roughness shape in the case where theobservation conditions are that the incidence angle θ=6 degrees and therotation angle φ=0 degrees. The illuminance distribution shown in FIG.22C is an ideal appearance. In FIG. 22C, the illuminance on the portioncorresponding to the plane 2003 and the illuminance on the portioncorresponding to the plane 2004 are different, and therefore, there is acontrast between the bright portion and the dark portion. Further, aconvex portion 2005 shows a sharp change in angle, and therefore, theboundary between the bright portion and the dark portion is visuallyrecognized clearly. On the other hand, FIG. 22D is a schematic diagramshowing an illuminance distribution 2104 of the roughness shapecorresponding to FIG. 22B. In FIG. 22D also, there is a contrast betweenthe bright portion and the dark portion. However, a convex portion 2006shows a change in angle duller than that of the convex portion 2005, andtherefore, the boundary between the bright portion and the dark portionin the illuminance distribution 2104 of the structure is visuallyrecognized with somewhat blurring. It is supposed that the roughnessshape represents a contrast of shade as in FIG. 22C in this manner.Despite this, in the roughness shape of the structure actually formed bythe image forming apparatus 200, even in the case where the roughnessshape data is within the output possible range 530, the contrast ofshade changes. With the above in mind, the image processing apparatus inthe present embodiment represents the feature of the appearance to belost because the image layer cannot reproduce the roughness shape in theimage layer by correcting the image data in accordance the predictedappearance of the roughness shape.

<Image Data Correction Processing Flowchart>

FIG. 19 is a flowchart showing details of the processing of the imagedata correction (S1801). At S1901, the roughness shape analysis unit 605calculates a height distribution HD′ in the structure formed by theimage forming apparatus 200 based on roughness shape data by analyzingthe roughness shape data. First, the roughness shape analysis unit 605acquires the height distribution HD of the roughness shape data. Next,the roughness shape analysis unit 605 calculates the height distributionHD′ as formula (1) for the height distribution HD.HD′(x,y)=HD(x,y)*F  (Formula 1)Here, F is a parameter in accordance with the output process of theimage forming apparatus 200 and the change-in-shape characteristics dueto the viscosity and the surface tension of the resin printing material,and the symbol * indicates that a convolution operation is performed. Fhas, for example, the Gaussian distribution and is used in the operationin formula (1) as a two-dimensional low-pass filter. By applying suchcharacteristics, it is possible to simulate the characteristics that asharp angle is dulled in the structure formed by the image formingapparatus 200 based on the roughness shape data.

At S1902, the roughness shape analysis unit 605 sets the observationconditions of the structure having the roughness shape. In the presentembodiment, the input of the observation conditions is received alongwith the image data (S701) and the observation conditions include anincidence angle θi and a rotation angle φi of a light source withrespect to the roughness shape. FIG. 20 is a schematic diagram showing aposition relationship between the incidence angle θi and the rotationangle φi of the light source of the present embodiment. The incidenceangle θi and the rotation angle φi are values that specify polarcoordinates indicating the direction of the light source in the three(xyz)-dimensional space in the case where the surface of the printingmedium 208 is taken to be the xy-plane. The incidence angle θi and therotation angle φi are used to calculate the ideal illuminancedistribution and the predicted illuminance distribution at S1903 andS1904, to be described later. In order to calculate the illuminancedistribution strictly, it is necessary to set, in addition to thedirection of the light source, several conditions, such as the portionof the roughness shape to be illuminated by the light source, the areaof the illuminated portion, the intensity of the dispersed lightcorresponding to the illumination light, the spectral distribution, theilluminance of the light source, the deflection angle characteristics ofthe roughness shape, and the observation direction. Because of this, theincidence angle θi and the rotation angle φi that give the greatestinfluence to the appearance of the shade of the roughness shape, i.e.,the direction of the illumination light, are set as the observationconditions. It can be said that the processing to set the observationconditions such as this by the roughness shape analysis unit 605functions as a so-called observation condition setting unit.

At S1903, the roughness shape analysis unit 605 calculates the idealilluminance distribution. The roughness shape analysis unit 605 performsprocessing to convert the height distribution HD of the roughness shapeacquired at S1901 into a normal distribution θ, φ (x, y) indicating inwhich direction the fine surface of the roughness shape faces. In moredetail, the normal distribution θ, φ (x, y) is calculated by calculatingthe gradient in the vicinity of the pixel of interest in the heightdistribution HD. By applying the observation conditions set at S1902,i.e., the incidence angle θi and the rotation angle φi, to the normaldistribution θ, φ (x, y), it is possible to obtain an ideal illuminancedistribution E1 (x, y) of the roughness shape of the object to bereproduced.E1=cos(θ−θi,φ−φi)  (Formula 2)At S1904, the roughness shape analysis unit 605 predicts an illuminancedistribution of the roughness shape of a structure obtained by the imageforming apparatus 200 outputting a resin printing material based on theroughness shape data. The roughness shape analysis unit 605 performsprocessing to convert the height distribution HD of the roughness shapeacquired at S1901 into the normal distribution θ, φ (x, y) indicating inwhich direction the fine surface of the roughness shape faces. In moredetail, the normal distribution θ, φ (x, y) is calculated by calculatingthe gradient in the vicinity of the pixel of interest in the heightdistribution HD. By applying the observation conditions set at S1902,i.e., the incidence angle θi and the rotation angle φi, to the normaldistribution θ, φ (x, y) (Formula 2), it is possible to obtain apredicted illuminance distribution E2 (x, y) of the roughness shape ofthe output structure.

Here, with reference to FIGS. 22E and 22F, the illuminance distributionin the present embodiment is explained. FIGS. 22E and 22F are diagramsexplaining the ideal illuminance distribution E1 and the predictedillumination distribution E2 at the time of being output, respectively,and the vertical axis represents the relative illuminance (%) and thehorizontal axis represents x (mm) in the case where the surface of theprinting medium 208 is taken to be the xy-plane. In the presentembodiment, as on the plane 2003 (FIG. 21), the illuminance in the casewhere the illumination direction and the normal agree with each other istaken to be 100% and in the case where the illumination direction andthe normal do not agree with each other as on the plane 2004 (FIG. 21),the illuminance drops in units of several %. As shown in FIG. 21, in theroughness shape 2001 having the convex portion 2005, the convex portion2005 shows a sharp change in angle in the case where x becomes a valuein the vicinity of 10 mm. In accordance with this, in a graph line 2105of the before-correction illuminance distribution E1, the illuminancechanges from 100% to 98% in the case where x becomes a value in thevicinity of 10 mm. On the other hand, in the roughness shape 2001 havinga convex portion 2006, the convex portion 2006 shows a smooth change inangle in the case where x becomes a value in the vicinity of 10 mm. Inaccordance with this, in a graph line 2106 of the after-correctionilluminance distribution E2, the illuminance changes from 100% to 98% inthe case where x becomes a value about between 8 mm and 12 mm.

Returning to the flowchart in FIG. 19 again, at S1905, the imageprocessing unit 604 performs correction for the image data the input ofwhich has been received at S701. At this time, the image processing unit604 first calculates a correction coefficient for the image data fromthe ideal illuminance distribution E1 and the predicted illuminancedistribution E2, and then, applies the calculated correction coefficientto the image data. It is possible to find the correction coefficient forthe image data from the ratio between the ideal illuminance distributionE1 and the predicted illuminance distribution E2 and for example, it ispossible to use formula (3) below.correction coefficient=E1/E2  (formula 3)It can be said that the processing to calculate a correction coefficientsuch as this by the image processing unit 604 functions as a correctioncoefficient calculation unit.

Here, in general, among the three-dimensional coordinate data of XYZ inthe color space (e.g., sRGB, Adobe RGB, etc.) in which image data isspecified, the “Y” component is a value representing illuminance. In thepresent embodiment, an illuminance distribution E is specified by theillumination direction from the light source and the normal and it ispossible to calculate the illuminance distribution E as the “change inthe Y component” among the three-dimensional coordinate data of XYZ. Theimage processing unit 604 converts the RGB image data the input of whichhas been received at S701 into three-dimensional coordinate data of XYZbased on the color space in which the image data is specified. Next, theimage processing unit 604 applies the calculated correction coefficientto the “Y” component among the converted three-dimensional coordinatedata of XYZ. For the application of the correction coefficient, it ispossible to use, for example, formula (4) below.Y′=Y(E1/E2)  (formula 4)As described above, Y is the “Y” component of the three-dimensionalcoordinate data of XYZ converted from the image data and Y′ correspondsto the “Y” component of the three-dimensional coordinate data of XYZafter the correction. The image processing unit 604 inversely convertsthe image data XY′ Z (x, y) after the correction including Y′ into RGBimage data again. After this, the RGB image data after the inverseconversion is subjected to the color separation processing as in ageneral image processing apparatus and binary halftone image data ofeach color is generated, and the flow of the image data correctionprocessing (FIG. 18) is terminated.

FIG. 23A is a diagram showing an example of the calculated correctioncoefficient. The correction coefficient is found from the ratio betweenthe ideal illuminance distribution E1 and the predicted illuminancedistribution E2 and a graph line 2210 representing the illuminancecorrection coefficient corresponds to the value of the ratio between theilluminance represented by the graph line 2105 of the ideal illuminancedistribution E1 and the illuminance represented by the graph line 2106of the predicted illuminance distribution E2. FIG. 23B is a schematicdiagram showing an example of before-correction image data 2220 beforethe image processing unit 604 performs the image data correction (S1905)and FIG. 23C is a schematic diagram showing an example ofafter-correction image data 2230 after the image processing unit 604performs the image data correction (S1905). In the present embodiment,the correction coefficient calculated from the ideal illuminancedistribution E1 and the predicted illuminance distribution E2 is appliedto the before-correction image data 2220 by the image processing unit604 and the after-correction image data 2230 including anafter-correction area 2231 representing the ratio of the appearancebetween E1 and E2 by a color is acquired. At S715, to be describedlater, the image layer based on the after-correction image data 2230 isprinted on the roughness layer, and therefore, even in the case wherethe texture of the roughness shape is lost, it is possible to compensatefor the appearance, such as sharpness, of the roughness shape by theafter-correction area 2231.

After this, at S715, the image forming apparatus 200 receives the binaryhalftone image data of each color after the correction and the roughnessshape data after the correction from the output unit 607. The imageforming apparatus 200 outputs an image layer from the binary halftoneimage data of each color after the correction and a roughness layer fromthe roughness shape data or the roughness shape data after thecorrection, respectively.

As explained above, the image processing apparatus of the presentembodiment controls the color of the image data so as to compensate forthe sharpness of the roughness shape, which has been lost, in thestructure output by the image forming apparatus 200 based on theroughness shape data. Due to this, it is possible to compensate for thetexture of the roughness shape.

Modification Example

In the present embodiment, for simplification of explanation, the heightdistribution that does not change in the y-direction is illustrated, butit is needless to say that this explanation effectively applies to anarbitrary height distribution in the two-dimensional field of x and y.

In the present embodiment, the example is explained in which theformation of the roughness shape and the formation of the image areperformed by the same image forming apparatus 200, but the example isnot limited to this as long as the gist of predicting the texture of theroughness shape after correction and controlling the color of the imageis followed. For example, such a configuration is also conceivable inwhich the image forming apparatus 200 forms an image for a roughnessshape formed separately by an apparatus other than the image formingapparatus 200. At this time, it is sufficient to change theconfiguration so as to have an acquisition unit configured to acquire anafter-correction height distribution and a before-correction heightdistribution of the roughness shape formed separately and an imageforming unit configured to form an image layer based on the acquiredinformation. Further, explanation is given on the assumption that theheight of the roughness shape, which is the target of the presentembodiment, is about 1 mm, but the height is not limited to this.Although the complicatedness or the like of the observation environmentwill change, it is possible to apply the present embodiment to aroughness shape having any size and shape.

In the present embodiment, the example is described in which thecorrection coefficient is calculated without taking into considerationthe inclination of the fine surface, but in fact, a method is alsoconceivable that calculates the correction coefficient of image data bytaking into consideration the change in the surface area due to theinclination of the plane of the roughness shape, the amount of ink, thesurface coatability of ink, etc.

In the present embodiment, the example is shown in which the correctionprocessing of image data is performed by using the “Y” component of thethree-dimensional coordinate data of XYZ, but it may also be possible toperform calculation by using a value in any space. Further, in thepresent embodiment, after the steps, such as the acquisition of theafter-correction height distribution of the roughness shape, the settingof the observation conditions, the calculation of the before-correctionilluminance distribution, and the calculation of the after-correctionilluminance distribution, are performed, the correction of image data isperformed. In the modification example, it is also possible to obtainthe similar effect by a method in which the calculation is simplified,the edge component is extracted by performing calculation processing,such as the second differentiation, for the data specifying the heightdistribution, the shade of the roughness is enhanced in a simple manner,etc. Further, in the setting of the observation conditions (S1902), onlythe direction of the illumination light from one light source is set,but in the actual observation environment, it is usual that there areinfluences of a plurality of light sources, reflected light from all thedirections, etc. Consequently, it is also possible to set theomnidirectional illumination intensity from the periphery in all thedirections as the observation condition. Due to this, it is madepossible to more exactly reflect the rate of change in illuminance dueto the inclination of the plane. Of course, it is possible to modify thecorrection coefficient by setting a predetermined coefficient in placeof a value having a physical meaning.

Fourth Embodiment

In the first embodiment and the second embodiment, the method isexplained in which the roughness shape data is corrected in the casewhere it is possible to maintain the desired texture by correcting theroughness shape data in accordance with the characteristics of theroughness shape. In the third embodiment, the method is explained inwhich the color of the image layer that is formed on the roughness layeris controlled based on the appearance of the roughness shape. In thepresent embodiment, the roughness shape data is corrected in accordancewith the characteristics of the roughness shape. Further, based on theappearance of the roughness shape in the case where the image formingapparatus 200 outputs the roughness shape based on the correctedroughness shape data, the color of the image layer that is formed on theroughness layer is controlled. In the present embodiment, a method ofimproving the texture of the roughness shape of the structure output bythe image forming apparatus 200 with the configuration such as this isexplained. In the explanation of the present embodiment, the samereference letters or numerals are attached to the same configurations asthose of the above-described embodiments and explanation of theduplicated contents is omitted.

FIGS. 24A and 24B are flowcharts showing a procedure performed by theimage forming system 1 of the present embodiment. In the flowchartsshown in FIGS. 24A and 24B, the processing other that at S1801 is thesame as the processing of the first embodiment, and therefore,explanation is omitted. Further, the processing at S1801 is the same asthat of the third embodiment, and therefore, explanation is omitted.

After each step of S707 and S711 to S714 is completed, the processingmoves to S1801 before proceeding to S715. At S1801, the image processingunit 604 acquires image data and performs correction processing for theimage data in order to print an image on a roughness layer that isformed based on roughness shape data. At S1901 in the image datacorrection (S1801), the roughness shape analysis unit 605 calculates theheight distribution HD′ in the structure formed by the image formingapparatus 200 based on the roughness shape data by analyzing theroughness shape data. The roughness shape data referred to here by theroughness shape analysis unit 605 may be uncorrected roughness shapedata or corrected roughness shape data. In the case where the processinghas moved from S707, the roughness shape data to be analyzed at S1901 isthe same as the roughness shape data input at S702. In the case wherethe processing has moved from S711, S712, S713, and S714, the roughnessshape data to be analyzed at S1901 is the same as the roughness shapedata corrected at each step.

After this, at S715, the image forming apparatus 200 receives the binaryhalftone image data of each color after the correction and the roughnessshape data after the correction from the output unit 607. The imageforming apparatus 200 outputs an image layer from the binary halftoneimage data of each color after the correction and a roughness layer fromthe roughness shape data or the roughness shape data after thecorrection, respectively. In the present embodiment, it is intended tocompensate for the appearance of the shade of the roughness shape, whichhas been lost due to the frequency correction (FIGS. 24A and 24B) of theroughness shape data, by controlling the color to be printed on theimage layer.

As explained above, the image processing apparatus of the presentembodiment controls the color represented by the image data so as tocompensate for the sharpness of the roughness shape, which has beenlost, in the structure output by the image forming apparatus 200 basedon the roughness shape data. Due to this, it is possible to compensatefor the texture of the roughness shape.

In the present embodiment, the aspect is explained in which theroughness shape that maintains the texture is output by predicting thetexture expected from the roughness shape after the correction andcontrolling the color to be printed on the image layer. Similarly, it isalso possible to apply the present invention to the followingembodiment. For example, for the roughness shape having an amplitudeoutside the texture maintaining range 504, it is also possible toperform control so as to output a roughness shape that maintains thetexture by predicting the texture expected from the roughness shapeafter the correction and controlling the color to be printed on theimage layer in the image forming apparatus 200.

In the fourth embodiment, in the case where it is determined that theroughness shape is not within the texture maintaining range at S706, theprocessing is terminated without forming the roughness layer or theimage layer. However, also in the case where the roughness shape isoutside the texture maintaining range of the image forming apparatus200, it may also be possible to cause the image forming apparatus 200 toform an output, although reproducibility is low. In this case, it ispossible to improve reproducibility by correcting the image data forforming the image layer so that the difference between the output by theimage forming apparatus 200 and the object to be reproduced iscompensated for as at S1801 described above.

Fifth Embodiment

In the fourth embodiment, the method is explained in which the roughnessshape data is corrected in accordance with the characteristics of theroughness shape and further, based on the appearance of the roughnessshape, the color of the image layer that is formed on the roughnesslayer is controlled. In the present embodiment, a method of settingwhether or not to perform the correction of the roughness layer and theimage layer is explained. Specifically, a method of specifying whetheror not to apply and output the roughness shape corrected at each of S711to S714 or of specifying whether or not apply and output the image datacorrected at S1801 via a user interface at S715 is explained.

At S715, the CPU 101 displays a user interface 2501 for receiving aninput of information relating to correction from a user on the monitor110. FIG. 25 is an example of the user interface 2501 for settingwhether or not to perform the correction of the roughness layer and theimage layer.

A before-correction pre-viewer 2502 is a viewer for checking in advancethe appearance of the output in the case where the correction of theroughness layer and the image layer is not performed. In thebefore-correction pre-viewer 2502, the appearance of the output that isoutput based on the roughness shape input at S702 and the image dataconverted at S704 under the observation conditions specified in anobservation condition input unit 2510, to be described later, isdisplayed as an image. It is possible to calculate the appearance of theoutput from the roughness shape, the image data, and the observationconditions as in the explanation in FIGS. 22C and 22D.

An after-correction pre-viewer 2503 is a viewer for checking in advancethe appearance of the output that is output based on the correctionmethod specified in a correction condition input unit 2520, to bedescribed later. In the after-correction pre-viewer 2503, the appearanceof the output that is output based on the observation conditionsspecified in the observation condition input unit 2510 and thecorrection method specified in the correction condition input unit 2520is displayed as an image.

The observation condition input unit 2510 is an interface forinstructing and inputting conditions at the time of observing theoutput. In the present embodiment, the observation condition input unit2510 includes a light source incidence angle input unit configured toinput an incidence angle of a light source as a numerical value and alight source rotation angle input unit configured to input a rotationangle of a light source as a numerical value. In the case where theinput conditions are changed, the images displayed in thebefore-correction pre-viewer 2502 and the after-correction pre-viewer2503 are calculated under the input observation conditions and displayedafter appropriately updated.

The correction condition input unit 2520 includes a roughness shapecorrection instruction unit 2501 and a color correction instruction unit2522 and is an interface for instructing and inputting a correctioncondition of an image displayed in the after-correction pre-viewer 2503.In the present embodiment, in the case where the checkbox of theroughness shape correction instruction unit 2521 is on, the roughnessshape corrected at each step of S711 to S714 is applied and the image inthe after-correction pre-viewer 2503 is updated and displayed. In thecase where the checkbox is off, the roughness shape input at S702 isapplied and the image in the after-correction pre-viewer 2053 is updatedand displayed. In the case where the checkbox of the color correctioninstruction unit 2522 is on, the appearance of the output to which theimage data corrected at S1801 is applied is displayed in theafter-correction pre-viewer 2503. In the case where the checkbox is off,the appearance of the output to which the image data converted at S704is applied is displayed in the after-correction pre-viewer 2503. Acorrection intensity instruction unit 2523 constituting the colorcorrection instruction unit 2522 specifies the amount of correction ofimage data to be corrected at S1801. The specified amount of correctionis applied to the image data by being multiplied by the correctioncoefficient described in, for example, formula (3).

A Print button 2504 and a Cancel button 2505 are buttons to determinewhether or not to perform the formation of the roughness layer and theimage layer. In the case where the Print button 2504 is pressed down,the image forming system 1 forms the roughness layer and the image layerbased on the correction condition input to the correction conditioninput unit 2520 at that point in time. In the case where the Cancelbutton 2505 is pressed down, the image forming system 1 terminates theprocessing without forming the roughness layer or the image layer.

As explained above, by using the user interface for receiving an inputof information relating to correction from a user, it is made possibleto check the appearance of the output in advance under the observationconditions and the correction condition specified by a user. Because ofthis, it is made possible to set the correction condition of the outputdesired by a user. There is a case where the effect of the image datacorrection that is applied in the present embodiment becomes lesssignificant and detrimental as the observation environment departs fromthe specified observation environment. In such a case, it is possible toadopt a method in which an input reception unit configured to specifywhether or not the observation conditions change is provided in theobservation condition input unit 2510 and in the case where theobservation conditions change, the image data correction is notperformed. Further, a method is also conceivable in which a mask imageor a range specified on the user interface is used and the correctioncondition is set and applied for each specified area.

Other Embodiments

Embodiment(s) of the present invention can also be realized by acomputer of a system or apparatus that reads out and executes computerexecutable instructions (e.g., one or more programs) recorded on astorage medium (which may also be referred to more fully as a‘non-transitory computer-readable storage medium’) to perform thefunctions of one or more of the above-described embodiment (s) and/orthat includes one or more circuits (e.g., application specificintegrated circuit (ASIC)) for performing the functions of one or moreof the above-described embodiment (s), and by a method performed by thecomputer of the system or apparatus by, for example, reading out andexecuting the computer executable instructions from the storage mediumto perform the functions of one or more of the above-describedembodiment (s) and/or controlling the one or more circuits to performthe functions of one or more of the above-described embodiment (s). Thecomputer may comprise one or more processors (e.g., central processingunit (CPU), micro processing unit (MPU)) and may include a network ofseparate computers or separate processors to read out and execute thecomputer executable instructions. The computer executable instructionsmay be provided to the computer, for example, from a network or thestorage medium. The storage medium may include, for example, one or moreof a hard disk, a random-access memory (RAM), a read only memory (ROM),a storage of distributed computing systems, an optical disk (such as acompact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)™),a flash memory device, a memory card, and the like.

According to the image processing apparatus of the present invention, itis possible to generate data for an image forming apparatus to output astructure so that the image forming apparatus can reproduce a structurewith a roughness shape having a desired texture.

While the present invention has been described with reference toexemplary embodiments, it is to be understood that the invention is notlimited to the disclosed exemplary embodiments. The scope of thefollowing claims is to be accorded the broadest interpretation so as toencompass all such modifications and equivalent structures andfunctions.

This application claims the benefit of Japanese Patent Applications No.2015-156035, filed Aug. 6, 2015, and No. 2016-129141, filed Jun. 29,2016, which are hereby incorporated by reference wherein in theirentirety.

What is claimed is:
 1. An image processing apparatus that suppliesroughness shape data to an image forming apparatus that forms aroughness shape based on a roughness shape of an object to bereproduced, the image processing apparatus comprising: one or moreprocessors; and one or more programs stored on the informationprocessing apparatus, wherein the one or more programs cause the one ormore processors to: receive an input of information representing theroughness shape of the object to be reproduced; acquire outputcharacteristics relating to a roughness shape that the image formingapparatus can output; and generate the roughness shape data that issupplied to the image forming apparatus based on the informationrepresenting the roughness shape of the object to be reproduced and theoutput characteristics, wherein the roughness shape data is generated soas to give more weight to at least one of a difference of elevation, aheight, and sharpness of a convex portion of the roughness shape of theobject to be reproduced.
 2. The image processing apparatus according toclaim 1, wherein, in determining, the instructions, when executed by theone or more processors, further causes the image processing apparatusto: determine whether or not to correct the information representing theroughness shape based on the information representing the roughnessshape of the object to be reproduced and the output characteristics, andin a case where it is determined that the information should becorrected, the roughness shape data is generated based on results ofcorrecting the roughness shape specified by the information representingthe roughness shape.
 3. The image processing apparatus according toclaim 2, wherein, in generating, the instructions, when executed by theone or more processors, further causes the image processing apparatusto: acquire a height distribution of the roughness shape of the objectto be reproduced and to calculate a height of the roughness shape of theobject to be reproduced and a spatial frequency of the roughness shapeof the object to be reproduced from the height distribution; determinewhether the height of the roughness shape of the object to be reproducedand the spatial frequency of the roughness shape of the object to bereproduced satisfy an output possible condition indicated by the outputcharacteristics; and in a case where the output possible condition isnot satisfied, generate the roughness shape data by correcting thereceived information representing the roughness shape based on theheight of the roughness shape of the object to be reproduced and thespatial frequency of the roughness shape of the object to be reproduced.4. The image processing apparatus according to claim 3, wherein, inacquiring, the instructions, when executed by the one or moreprocessors, further cause the image processing apparatus to: acquire anoutput possible range in which the image forming apparatus can outputthe roughness shape with a high reproducibility; and generate theroughness shape data so that the height of the roughness shape of theobject to be reproduced after the correction and the spatial frequencyof the roughness shape of the object to be reproduced after thecorrection fall within the output possible range.
 5. The imageprocessing apparatus according to claim 2, wherein the instructions,when executed by the one or more processors, cause the image processingapparatus to: acquire an amplitude upper limit, which is an upper limitof an amplitude at which the image forming apparatus can output theroughness shape with a high reproducibility, and a frequency upperlimit, which is an upper limit of a frequency at which the image formingapparatus can output the roughness shape with a high reproducibility, asthe output characteristics; and determine whether the height of theroughness shape of the object to be reproduced is less than or equal tothe amplitude upper limit and whether a spatial frequency of theroughness shape of the object to be reproduced is less than or equal tothe frequency upper limit.
 6. The image processing apparatus accordingto claim 5, wherein the instructions, when executed by the one or moreprocessors, cause the image processing apparatus to: subtract a heightminimum value in a height distribution from the height of the roughnessshape of the object to be reproduced in a case where the height of theroughness shape of the object to be reproduced is higher than theamplitude upper limit.
 7. The image processing apparatus according toclaim 5, wherein the instructions, when executed by the one or moreprocessors, cause the image processing apparatus to: perform aconvolution operation of a height distribution with a filter havinglow-frequency characteristics in a case where the spatial frequency ofthe roughness shape of the object to be reproduced is higher than thefrequency upper limit and restores the height of the roughness shape ofthe object to be reproduced, which has been reduced by the convolutionoperation.
 8. The image processing apparatus according to claim 1,wherein the instructions, when executed by the one or more processors,further causes the image processing apparatus to: correct image datarepresenting an image layer that is formed on the roughness shape inaccordance with an appearance of a roughness shape that the imageforming apparatus outputs based on the roughness shape data.
 9. Theimage processing apparatus according to claim 8, wherein, in correcting,the instructions, when executed by the one or more processors, cause theimage processing apparatus to: acquire an ideal roughness shapespecified by the received information representing the roughness shapeand a predicted roughness shape in a case where the received informationrepresenting the roughness shape is output in the image formingapparatus; set observation conditions of the ideal roughness shape andthe predicted roughness shape; and calculate the appearance of the idealroughness shape and the appearance of the predicted roughness shapeunder the observation conditions and to calculate a correctioncoefficient for image data from the appearance of the ideal roughnessshape and the appearance of the predicted roughness shape; and correctthe image data based on the calculated correction coefficient.
 10. Theimage processing apparatus according to claim 9, wherein the observationconditions include a direction of illumination light that is illuminatedto the roughness shape from a light source, an illuminance distributionof the ideal roughness shape is found from the direction of theillumination light that is illuminated to the ideal roughness shape andan illuminance distribution of the predicted roughness shape is foundfrom the direction of the illumination light that is illuminated to thepredicted roughness shape, respectively, and the appearance of the idealroughness shape is calculated from the illuminance distribution of theideal roughness shape and the appearance of the predicted roughnessshape is calculated from the illuminance distribution of the predictedroughness shape.
 11. The image processing apparatus according to claim1, wherein the received information representing the roughness shape isdata representing the height of the roughness shape of the object to bereproduced for each pixel, and wherein the instructions, when executedby the one or more processors, further cause the image processingapparatus to: divide the information representing the roughness shapeinto a plurality of areas; analyze the information representing theroughness shape of each divided area; calculate a weight coefficient ofeach of the divided areas based on results of the analysis; and adjust adeviation in the roughness shape in each of the divided areas from theroughness shape data of each of the divided areas generated and thecalculated weight coefficient.
 12. An image processing apparatus thatsupplies roughness shape data to an image forming apparatus that forms aroughness shape based on a roughness shape of an object to bereproduced, the image processing apparatus comprising: one or moreprocessors; and one or more programs stored on the informationprocessing apparatus, wherein the one or more programs cause the one ormore processors to: receive an input of information representing theroughness shape of the object to be reproduced; acquire outputcharacteristics relating to a roughness shape that the image formingapparatus can output; and generate the roughness shape data that issupplied to the image forming apparatus based on the informationrepresenting the roughness shape of the object to be reproduced and theoutput characteristics, wherein the roughness shape data is generated soas to maintain at least one of a difference of elevation, a height, andsharpness of a convex portion of the roughness shape of the object to bereproduced.
 13. An image forming apparatus that: forms a roughness shapebased on a roughness shape of an object to be reproduced; receivesgenerated roughness shape data from an image processing apparatuscomprising: one or more processors; and one or more programs stored onthe information processing apparatus, wherein the one or more programscause the one or more processors to: receive an input of informationrepresenting the roughness shape of the object to be reproduced; acquireoutput characteristics relating to a roughness shape that the imageforming apparatus can output; and generate the roughness shape datarepresenting the roughness shape based on the information representingthe roughness shape of the object to be reproduced and the outputcharacteristics; and forms the roughness shape based on the roughnessshape data which has been received, wherein the roughness shape data isgenerated so as to give more weight to at least one of a difference ofelevation, a height, and sharpness of a convex portion of the roughnessshape of the object to be reproduced.
 14. An image processing method ofsupplying roughness shape data to an image forming apparatus that formsa roughness shape based on a roughness shape of an object to bereproduced, the method comprising: receiving an input of informationrepresenting the roughness shape of the object to be reproduced;acquiring output characteristics relating to a roughness shape that theimage forming apparatus can output; and generating the roughness shapedata that is supplied to the image forming apparatus based on theinformation representing the roughness shape of the object to bereproduced and the output characteristics, wherein the roughness shapedata is generated so as to give more weight to at least one of adifference of elevation, a height, and sharpness of a convex portion ofthe roughness shape of the object to be reproduced.
 15. A non-transitorycomputer readable storage medium storing a program for causing acomputer to function as an image processing apparatus that suppliesroughness shape data to an image forming apparatus that forms aroughness shape based on a roughness shape of an object to bereproduced, wherein the image processing apparatus comprises: at leastone or more processors; and one or more programs stored on theinformation processing apparatus, wherein the one or more programs causethe one or more processors to: receive an input of informationrepresenting the roughness shape of the object to be reproduced; acquireoutput characteristics relating to a roughness shape that the imageforming apparatus can output; and generate the roughness shape data thatis supplied to the image forming apparatus based on the informationrepresenting the roughness shape of the object to be reproduced and theoutput characteristics, wherein the roughness shape data is generated soas to give more weight to at least one of a difference of elevation, aheight, and sharpness of a convex portion of the roughness shape of theobject to be reproduced.
 16. An image processing method of supplyingroughness shape data to an image forming apparatus that forms aroughness shape based on a roughness shape of an object to bereproduced, the method comprising: receiving an input of informationrepresenting the roughness shape of the object to be reproduced;acquiring output characteristics relating to a roughness shape that theimage forming apparatus can output; and generating the roughness shapedata that is supplied to the image forming apparatus based on theinformation representing the roughness shape of the object to bereproduced and the output characteristics, wherein the roughness shapedata is generated so as to maintain at least one of a difference ofelevation, height, and sharpness of a convex portion of the roughnessshape of the object to be reproduced.
 17. A non-transitory computerreadable storage medium storing a program for causing a computer tofunction as an image processing apparatus that supplies roughness shapedata to an image forming apparatus that forms a roughness shape based ona roughness shape of an object to be reproduced, wherein the imageprocessing apparatus comprises: at least one or more processors; and oneor more programs stored on the information processing apparatus, whereinthe one or more programs cause the one or more processors to: receive aninput of information representing the roughness shape of the object tobe reproduced; acquire output characteristics relating to a roughnessshape that the image forming apparatus can output; and generate theroughness shape data that is supplied to the image forming apparatusbased on the information representing the roughness shape of the objectto be reproduced and the output characteristics, wherein the roughnessshape data is generated so as to maintain at least one of a differenceof elevation, a height, and sharpness of a convex portion of theroughness shape of the object to be reproduced.